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Media Routing 

Technical Field 

The present invention relates generally to 
routing, transforming, and delivering media between 
5 network resources . 

Background 

The Internet is a global communications 
network interconnecting a vast number of computers and 
networks via communications links. The Internet 

10 represents a highly distributed system made up of 

routers and hosts. Hosts are computers that exist at 
the edges of the network and generate the traffic that 
routers in turn deliver to other hosts . An example of a 
host generating traffic is a computer using a web 

15 browser specifying a request for a web page. Data sent 
from one host to another on the Internet might go 
through many routers before reaching its destination 
host . 

Routers on the Internet make routing decisions 
20 based on Internet Protocol (IP) address and knowledge 
gained from surrounding routers. An IP address is a 
unique number identifying every host connected to the 
Internet. Routers have ports, or physical connections, 
for sending and receiving data. Routers receive data, 
25 examine the header information appended to the data for 
a destination address (for example, the IP address of 
the destination host) , and compare the destination 
address against an internal database called a routing 
table. The routing table has information about which of 
30 its ports data destined for a particular address should 



be sent out. Thus, a data packet comes in one port of a 
router, its destination address is examined and compared 
to its routing table, and the data is then sent out a 
particular output port on its way to the next router (or 
the destination host if that host is connected to this 
router) . 

Routers and hosts exist in subnets that are 
connected to other subnets, via routers, forming the 
Internet. New subnets can be added at any time, as can 
faster routers. Since the Internet is inherently 
organic, addition of new components requires only 
localized changes and does not necessitate a massive 
network upgrade. The network, as represented by the 
Internet, is thus capable of automatically adjusting and 
absorbing new functionality 

In a typical client -server model on the 
Internet, a client computer first requests information 
from a server computer in the form of an HTTP (Hypertext 
Transfer Protocol) request. For example, the client 
computer may request a particular web page from the 
server computer. The server computer needs the 
application to which the request is being sent running 
and listening for data at a particular port on the 
server. The server processes the HTTP request and 
responds by sending the requested web page to the client 
in the form of an HTTP response. 

Instead of a user at a client computer 
manually transmitting an HTTP request (for example, by 
typing in the Uniform Resource Locator (URL) of a web 
page address or by clicking on a link to a web page) , 
Internet browsers on client computers can be configured 
to have web pages automatically "pushed" to them from 
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server computers. This is sometimes referred to as 
"subscribing" to a web site. Subscribing to a web site 
allows the information to which the user subscribed to 
be sent to the browser at regular intervals. This form 
5 of push technology still requires the client computer to 
issue an HTTP request for the information; the client 
web browser is configured by the user to automatically 
contact the server web site subscribed to at intervals 
specified by the user to check to see if information has 

10 been updated and if so, issue an HTTP request for the 

information. Therefore , it would be desirable to enable 
a computer on a network to send data to another computer 
without the recipient computer having to first request 
the information and without the recipient computer to 

15 have a particular application the data is destined for 
running and listening on a particular port. 

Networks such as the Internet use addressing 
schemes such as Internet Protocol to uniquely identify 
every computer connected to the Internet . In the 

20 client -server environment, when a host sends the HTTP 
response to an HTTP request, the HTTP response is only 
sent to the client computer, and the client computer via 
an application such as a web browser decides how to 
handle the data, for example, by displaying the data on 

25 the screen in the form of a web page. However, the 

server computer can not control to which resource on the 
client (e.g., the screen, hard disk drive, or speakers) 
the data should be directed. Therefore, it would be 
desirable to have a system that allows a host to 

30 transmit data to a particular resource on another host. 

Many different types of appliances, such as 
telephones and hand-held computers, are now being 



- 4 - 

connected to the Internet . Such appliances often have 
very little memory and have limited display 
capabilities. As a result, such appliances have 
difficulty processing high-bandwidth data. It would be 
5 desirable to have a system that can transmit data to 

such devices more efficiently so as not to overload the 
their limited capabilities. 

Summary Of The Invention 

As set forth below, a need exists for an 
10 improved method and system for routing data from a 

source resource on a source appliance across a network 
to a destination resource on a destination appliance. 
The method and system of the invention satisfies that 
problem. 

15 According to one aspect of the invention, 

there is a method and system provided that routes data 
from a source resource on a source appliance to a 
destination appliance without specifying a specific 
destination resource on the destination appliance to 

20 which the data is routed. A mapping algorithm on the 
destination appliance determines the destination 
resource to which the data is routed. Alternatively, a 
particular destination resource is specified. 

According to another aspect of the invention, 

25 the data can be routed from a source resource on a 
source appliance, to any number of intermediate 
resources on intermediate appliances, and finally to a 
destination resource on a destination appliance. 

According to another aspect of the invention, 

30 a system and method is provided to discover the 
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appliances connected to the network, and to discover the 
resources connected to the appliances. 

According to another aspect of the invention, 
a system and method is provided for a user to 
5 selectively route data from a source resource on a 
source appliance to a destination appliance or a 
destination resource on the appliance. 

Brief Description Of The Drawings 

The accompanying drawings illustrate certain 
10 embodiments of the invention. 

Figs, la and lb illustrate a system according 
to one embodiment of the present invention. 

Fig. 2 illustrates a sample of the contents of 
a Table Of Known Appliances incorporated in the 
15 embodiment as shown in Figs, la and lb. 

Fig. 3a illustrates a sample of the contents 
of a Table Of Resources On An Appliance incorporated in 
the embodiment as shown in Figs, la and lb. 

Fig. 3b illustrates a sample of the contents 
20 of a Table Of Special Cases incorporated in the 
embodiment as shown in Figs . la and lb . 

Figs. 4 and 5 are flowcharts illustrating a 
process of discovering appliances and resources executed 
by the system shown in Figs . la and lb . 
25 Fig. 6 is a flowchart illustrating a process 

of the user controlling the routing of data through the 
system shown in Figs, la and lb. 

Fig, 7 is a flowchart illustrating a process 
of routing data executed by the system shown in Figs, la 
30 and lb. 
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Fig. 8 is a flowchart illustrating a process 
of routing data executed by the system shown in Figs, la 
and lb . 

Figs. 9a and 9b illustrate sample user 
interfaces for routing data operating on the system 
shown in Figs . la and lb . 

Figs. 10a, 10b, 10c and lOd illustrate sample 
user interfaces for configuring resources operating on 
the system shown in Figs, la and lb. 

Fig. 11 illustrates a sample user interface 
for routing data operating on the system shown in Figs, 
la and lb. 

Fig. 12 is a flowchart illustrating a process 
of routing data executed by the system shown in Figs, la 
and lb. 

Detailed Descrip tion 

Media Objects 

A system is provided that encapsulates any 
resource on an appliance providing each resource with a 
common interface. An example of an appliance is a 
computer, and examples of resources on such an appliance 
are a speaker, a microphone, a screen, and a voice-to- 
text application. Each resource is encapsulated via 
object-oriented programming techniques. An encapsulated 
resource is referred to as a "media object" . Once 
encapsulated, the only way to access the resource is 
through the media object. U.S. Patent Application No. 
09/3 04,973 entitled "Method And System For Generating A 
Mapping Between Types Of Data" (the "mapping algorithm") 
and U.S. Patent Application No. 09/474,664 entitled 
"Method And System For Data Demultiplexing" (the "Demux 
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algorithm") (collectively referred to as the "conversion 
system"), incorporated herein by reference, discuss an 
intra-appliance conversion system which enables data 
output from one media object to be converted into a 
5 format suitable for input to a destination media object. 
The mapping algorithm determines the sequence of 
routines to process a stream of data. The Demux 
algorithm is the instantiation of state associated with 
the sequence of routines processing the stream of data. 

10 Once the appliance is connected to a network, 

the same algorithms used to manage the routing of data 
intra-appliance can be applied to the routing of data 
between appliances. All resources, whether on a 
particular appliance or distributed across a network are 

15 treated as network resources. Network protocols such as 
TCP, IP and Ethernet can be encapsulated as media 
objects so that the problem of transferring data across 
a network is solved by the same conversion routines 
described in the aforementioned patent applications. 

20 The resources on an appliance are treated as a subnet, 
and routing between two appliances becomes the same 
problem as routing between two subnets on the Internet. 
Much like an IP packet can visit multiple network hops, 
data can be routed through multiple appliances in the 

25 delivery of data from a start to an end point. The data 
can be transformed by the appliance at each hop. This 
distributes the processing of the data across all the 
appliances in the path. Further, since standard network 
protocols are used for inter-appliance communication, 

30 the system is able to extend its communications 

capabilities to appliances that do not have resources 
encapsulated as media objects. 
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Figure 1 shows an embodiment of a system 
incorporating the present invention. In general, the 
embodiment provides a method and apparatus for routing 
media from a source resource on a source appliance 
5 connected to a network to a destination resource on a 
destination appliance connected to a network (sometimes 
referred to as "target resource" and "target 
appliance"). In this embodiment, the system includes 
the following appliances: computer 100, telephone 110, 
10 television 115, thermostat 120, handheld computer 125 
and printer 152. Each resource on appliances 100, 110, 

115, 12 0 and 125 is encapsulated as a media object. 
Other resources encapsulated as media objects include 
the various networking protocols operating on each 

15 appliance or interface, including TCP, IP, UDP, 

Ethernet, etc. The conversion system operates on 

processors 101, 127, 142 and 157. 

Computer 100 includes a processor 101, memory 

102, interface 13 0, and the following resources: speaker 
20 103, disk drive 104, screen 105, microphone 106, 

keyboard 107, mouse 108, CD-ROM 109 and text-to- voice 

application 170. 

Telephone 110 includes the following 

resources: microphone 111, speaker 112 and keypad 113. 
25 Television 115 includes the following resources: screen 

116, speaker 117 and keypad 118. Thermostat 120 
includes the following resources: thermometer 121, 
display 122 and keypad 123. Computer 100 is connected 
to network 150 via interface 130. Interface 130 can be 

30 an Ethernet adapter card or other network adapter. 

Appliances 110, 115 and 120 are connected to network 150 
via interfaces or network adapters 140. 
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Network adapter 140 includes processor 142 and 
memory 144. Network adapter 14 0 encapsulates as media 
objects via standard object oriented programming 
techniques the resources available on each appliance to 
5 which it is connected. Each resource, once encapsulated 
as a media object, is thereby made available as a 
network resource available to any of the other network 
resources. The conversion system operates on network 
adapter 14 0. 

10 Network 150 can be a local area network or 

other electronic network connecting appliances 
geographically close to one another. Network 150 is 
connected to gateway interface 155. Gateway interface 
155 includes processor 157 and memory 158. Gateway 

15 interface 155 connects network 150 to network 160. 
Network 160 can be the Internet or other network. 
Gateway 165, computer 175, telephone 180, television 185 
and thermostat 190, attached to LAN 195, all operate in 
the same manner and have the same resources as do the 

20 corresponding appliances attached to LAN 150. 

Handheld computer 12 5 includes the following 
resources: memory 12 6, processor 12 7, monochrome screen 
128 and speaker 129. Handheld computer 125 is connected 
to LAN 150 via network adapter 141. Network adapter 141 

25 is an RF interface to LAN 150. The conversion system 
operates on network adapter 141. 

Printer 152 is connected to network 150 and 
does not have the conversion system operating on it. 
Its resources are not encapsulated as media objects. 
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Media Routiner 

To route content from a source resource on a 
source appliance to a target appliance or target 
resource, information about the target appliance must be 
5 known to the source appliance to appropriately 

encapsulate the content. Figure 2 is an example of a 
Table of Known Appliances. The table is stored in the 
memory of the source appliance or is otherwise 
accessible to the source appliance. The table lists the 

10 following attributes about each appliance connected to 
the local network: appliance ID, which by example is 
the IP address of the appliance; a Friendly Name of the 
appliance, which is a name recognizable to a user, for 
example "Downstairs TV" ; a Browse URL (Uniform Resource 

15 Locator) which is the URL of the page containing a menu 
which lists the resources on the appliance and lists the 
appliances and resources connected to that appliance 
(this menu is discussed in detail below with reference 
to the Figures 9a and 9b) ; Image URL , which contains the 

20 URL of the graphical image that might appear next to the 
Friendly Name of the appliance on a menu presented to a 
user, for example an image of a television; and the 
appliance routing address string, which contains the 
series of hops through which the data must be routed to 

25 place the data in a format that the destination 

appliance can read, for example, MediaRouter/UDP/lP . An 
example of such a routing address string is 
"MediaRouter (13) /TCP (0) (E, 9999)/IP(0)( - ,10.1.1.2)". 
Illustratively, data can be sent via HTTP, and the media 

30 router, which uses HTTP as its header, includes the 
source content -type, for example, image/GIF or 
text/HTML, and the content length representing the 
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number of bytes in the pay load. The source content -type 
is used by the destination appliance's mapping engine to 
determine the target resource on the destination 
appliance . 

5 To route content from a source resource on a 

source appliance to a destination resource on a 
destination appliance, information about the destination 
resource must be known to the source appliance to 
appropriately encapsulate the content for routing across 

10 the network. Figure 3a is an example of a Table Of 
Resources On An Appliance. One of these tables in 
Figure 3a exists for each appliance listed in the Table 
Of Known Appliances. The Table Of Resources On An 
Appliance is stored in the memory of the source 

15 appliance or is otherwise accessible to the source 

appliance. As illustrated in Figure 3a, the table lists 
the following attributes about the resources connected 
to an appliance: Resource Name, which is a name 
recognizable to a user, for example "Speaker" ; a 

20 Resource Image URL, which is the URL of the graphical 

image that appears next to the Resource Name; Configure 
URL, which is the URL of the web page containing the 
controls to configure the resource (Figs. lOa-lOd, 
discussed below, are examples of such a web page) ; and 

25 the Content-Type Address String, which contains the 
format of the type of media that the resource can 
process. Illustratively, data is sent via HTTP, and the 
HTTP media router, or header, includes the destination 
content -type address string, for example 

30 RemoteTarget (Speaker) . The destination content-type is 
used by the destination appliance's mapping algorithm to 
map the content to the specified resource. 
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If a particular resource on a destination 
appliance needs a special conversion routine performed 
on it prior to transmission depending on the type of 
source content, then an entry for that source content 
5 type will appear in the Table Of Special Cases in Figure 
3b under the heading Source Media. The special target 
address string appears under the heading Special 
Address. For example, if the source content -type is 
GIF, and the target resource needs GIF translated to 
10 JPEG, then an entry may appear as shown in the Table Of 
Special Cases in Figure 3b with the following special 
routing address string: 

"GIFtoJPEG/RemoteTarget (Screen) /MediaRouter/TCP/IP" . 
This entry is used as the routing address string in the 
15 header. 

One embodiment allows data, or "content" to be 
routed from a source resource on one appliance to a 
target appliance without specifying to which resource on 
the target appliance the content is directed. For 

20 example, content such as JPEG from CD-ROM drive 109 on 
computer 100 can be routed to television 115. When the 
embodiment routes content from one appliance to another, 
it does so without having received a request from any of 
the targeted resources. 

25 Routing data, or "content" such as audio or 

video from a source resource to a target appliance 
located across a network without specifying the target 
resource on the target appliance will now be described 
with reference to Figure 7. First, a header is built 

30 containing at least the source content-type and the 

destination appliance routing address string (Step 705) . 
The source content -type describes the type of media the 
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data represents, for example, JPEG, MPEG, GIF, HTML, 
PCM, MP-3, etc. The destination appliance routing 
address is found in the table of known appliances. 
Next, the content is encapsulated in the header (Step 
5 710) . The mapping algorithm on the source appliance 

then determines, using the destination appliance routing 
address string, the series of conversion routines 
necessary to transmit the content to the destination 
appliance across the network (Step 712) . Then the Demux 

10 algorithm on the source appliance effects the conversion 
of the content for transmission across the network 
(Step. 714) . The encapsulated content is then 
transmitted across the network to the destination 
appliance (Step 715) . Upon receipt of the encapsulated 

15 content, the destination appliance parses the header, 

identifying the source content-type from the information 
in the header (Step 720) . The mapping algorithm then 
determines what the target content -type should be based 
on the available resources on this appliance, and 

20 identifies the series of conversion routines to convert 
the source content-type to the target content-type (Step 
725) . Finally, the destination appliance converts the 
data from the source type to the target type using the 
Demux algorithm which routes the data through a sequence 

25 of routines identified by the mapping algorithm to 

effect the conversion of the data to the target format 
(Step 730) . 

Thus, in the example of routing JPEG content 
from CD-ROM 109 to television 115, the user need not 
30 specify that the content be routed to screen 116. Using 
the switchboard (described below with reference to 
Figures 9a and 9b) , the user can direct that the content 
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from CD-ROM 109 be routed to television 115. The header 
is built containing at least the content- type , here 
JPEG, and the routing address string of television 115, 
which by example could be MediaRouter/UDP/lP . The 
5 content is encapsulated in the header. The mapping and 
Demux algorithms operating on processor 101 use the 
routing address string of television 115 to determine 
the format to transmit the content, which by example 
uses the HTTP, UDP and IP protocols, and effect the 

10 conversion. The mapping algorithm operating on 
interface 14 0 connected to television 115 then 
determines, based on the source content- type , how to 
best convert the content so it can be understood by one 
of the resources on television 115. In the example of 

15 JPEG content from CD-ROM 10 9 transmitted to television 
115, the mapping algorithm might determine that bit -map 
is the best content -type to which the content should be 
converted, and then the Demux algorithm would effect the 
conversion and the content would be displayed on the 

20 screen. 

Alternatively, the user can specify the 
particular resource on the destination appliance to 
which the content is to be routed. Routing content from 
a source resource on a source appliance to a specified 

25 target resource on a target appliance will now be 

described with reference to Figure 8. First, a header 
is built containing the source content -type, the target 
appliance routing address string (obtained from the 
Table of Known Appliances in Figure 3a) , and the target 

30 content -type address string (from the Table of Resources 
On An Appliance) (Step 805) . If the destination 
resource needs a particular content-type converted to 
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another content -type before receiving it, then the entry 
under Special Address from the Table of Special Cases in 
Figure 3b is used as the destination appliance routing 
address string instead of the entry found in the Table 
5 of Known Appliances. Next, the content is encapsulated 
in the header (Step 810) . The mapping algorithm on the 
source appliance then determines, using the destination 
appliance routing address string and the content-type 
address string, the series of conversion routines 

10 necessary to transmit the content to the target resource 
on the target appliance (Step 812) . Then the Demux 
algorithm on the source appliance effects the conversion 
of the content for transmission across the network 
(Step. 814) . The encapsulated content is then 

15 transmitted across the network o the destination 

appliance (Step 815) . Upon receipt of the encapsulated 
content, the destination appliance parses the header, 
identifying the source content-type and the target 
content-type from the information in the header (Step 

20 820) . The content- type address string identifies the 
targeted content -type . The mapping algorithm then 
determines the series of conversion routines to convert 
the source content-type to the target content-type (Step 
825) . Finally, the Demux algorithm effects the 

25 conversion of the content from the source content -type 
to the target content-type by executing the sequence of 
conversion routines determined by the mapping algorithm. 
(Step 830) . 

An example of the routing of data according to 
30 the steps in Figure 8 will now be described. The user 
may choose to send content from a text file, such as an 
HTML email, stored on disk drive 104 to speaker 112 on 



i Mir 111 HIM ' 1 " 



T 



- 16 - 

telephone 110. The content would be routed as described 
above with reference to Figure 8 to interface 14 0 on 
telephone 110. The mapping algorithm running on 
interface 140 would recognize that one of the conversion 
5 routines necessary to convert HTML to PCM is a resource 
located on an appliance listed in its Table of Known 
Appliances (in Figure 1, the text-to-voice application 
is a resource on computer 100) . The mapping algorithm 
on interface 140 would include text-to-voice application 

10 170 in its series of conversion routines. The Demux 

algorithm on interface 14 0 would then route the content 
through the series of conversion routines specified by 
the mapping algorithm, including encapsulating the 
content in the appropriate header to transmit the 

15 content to text-to-voice application 170. Text-to-voice 
application 170 would then operate on the content to 
translate the HTML to PCM, and then the content is 
encapsulated in the appropriate header, sent through the 
series of conversion routines determined by the mapping 

20 algorithm, and transmitted back to speaker 112 on 

telephone 110 in accordance with the steps in Figure 8. 
The content would now be in PCM format, a format 
understood by speaker 112, and the HTML email is heard 
on speaker 112. Those skilled in the art will recognize 

25 that interface 14 0 on telephone 110 need not have a 

large amount of memory or processing capacity to store 
all possible conversion routines and convert all types 
of data; as long as a needed resource is available 
somewhere on the network, interface 14 0 can take 

30 advantage of the resources and processing power of other 
appliances on the network. This reduces the complexity 
and cost of interface 140. 
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In another example, the user may choose to 
send color video content from CD-ROM 10 9 on computer 10 0 
to monochrome screen 126 on handheld computer 125. The 
content would be routed as described above with 
5 reference to Figure 8. Importantly, the content-type 
address string found in the Table Of Resources (Figure 
3a) for the monochrome speaker is 

RemoveColor/RemoteTarget (Screen) . RemoveColor indicates 
to the mapping algorithm on Computer 10 0 to include in 

10 the series of conversion routines a routine to strip out 
the color from the video stream content, thereby 
reducing the bandwidth necessary to transmit the content 
to handheld computer 125, and reducing the processing 
power necessary on handheld computer 100. 

15 In another example, the user can transmit 

content from a source resource located across a wide 
area network (WAN) to a target gateway interface, and 
the mapping and Demux algorithms operating on the 
gateway interface determine how the source content 

20 should be converted based on the appliances and 

resources connected to the LAN. The user on a WAN only 
needs to know the network address of the gateway 
interface. The gateway interface then determines how to 
best handle the arriving content from the WAN, which can 

25 be determined on- the -fly through the mapping algorithm 
on gateway interface or set by the home user through a 
pre -determined mapping (for example, the home user may 
want all video mapped to his computer screen) . Such an 
example will now be described with reference to Figure 

30 1. A user at computer 175 might choose to transmit 

content from the CD-ROM on his computer to the home of 
the person located at gateway interface 155, but the 
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sender does not care how the content is processed once 
it arrives. This example is similar to that described 
with reference to Figure 7 above. The content is 
encapsulated in a header containing the target appliance 
5 routing address string, which here is the routing 

address string of gateway interface 155, and transmitted 
across LAN 195, through gateway interface 165, across 
WAN 160 to gateway interface 155. The mapping algorithm 
operating on gateway interface 155 determines the 

10 sequence of conversion routines to convert the CD-ROM 
content -type to an appropriate target content -type 
suitable for one of the appliances connected to LAN 150. 
Alternatively, the home user can set the mapping engine 
in gateway interface 155 to 

15 Alternatively, the user at computer 175 can 

access the switchboard (described below with reference 
to Figures 9a and 9b) of gateway interface 155 to see 
the appliances and resources connected to LAN 150. By 
accessing the switchboard, the user can select the 

20 particular appliance on LAN 150, or resource on an 

appliance connected to LAN 150, to which content can be 
directed from computer 175 . 

Another embodiment will now be described with 
reference to Figure 12. In this embodiment, content may 

25 be routed from a source resource to a destination 
resource making hops to other appliances along the 
route. First, the source content -type and destination 
content -type are examined by the mapping engine on the 
source appliance to determine the series of conversion 

30 routines necessary to convert the source content-type to 
the destination content - type . If the mapping algorithm 
determines that a resource located on an appliance other 
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than the source or destination appliance is needed to 
convert the content to the appropriate format for the 
destination appliance, then the mapping algorithm will 
indicate that the routing address string for this 
5 intermediate appliance in the header must be included in 
the header (Step 12 02) Next, a header is built 
containing the source content- type , destination 
appliance routing address string, destination content- 
type address string, and any routing address strings for 

10 other appliances the content must be routed through 

along the way to the destination appliance, referred to 
as intermediate appliances (Step 1205) . Next, the 
content is encapsulated in the header (Step 1210) . Then 
the Demux algorithm on the source appliance effects the 

15 conversion of the content for transmission across the 

network to the next intermediate appliance (Step 1215) . 
The encapsulated content is then transmitted across the 
network to the next intermediate appliance (Step 1220) . 
The intermediate appliance parses the header, and 

20 identifies the source content-type and destination 

content -type from the information in the header (Step 
1225) . Then the mapping algorithm operating on the 
intermediate appliance identifies the series of routines 
to convert the source content-type to the destination 

25 content -type, or to convert the source content -type to 
an intermediate content-type (Step 1230) . The 
intermediate content -type might be the output of a 
series of conversions that must occur to convert the 
source content-type to the destination content- type . 

30 Next, the Demux algorithm effects the conversion 

routines identified by the mapping algorithm in step 
1230 (Step 1235) . If the content is on the destination 
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appliance, then it is routed to the destination resource 
on the appliance (Steps 124 0 and 1245) . If the content 
is not at the destination appliance, then the header is 
stripped of this intermediate appliance's routing 
5 address string, and the source content-type is changed 
to content -type of the output of the conversion routine 
on this appliance (Steps 124 0 and 1248) , the content is 
transmitted to the next appliance indicated in the 
header (Step 1250) , and the flowchart loops back up to 

10 Step 1225. The flowchart continues this loop until the 
content has been routed through all the appliances 
necessary to convert the source content -type to the 
destination content- type . 

An example following the steps of Figure 12 

15 will now be discussed. A user might wish to route sound 
from microphone 111 on telephone 110 to screen 116 on 
television 115. To accomplish this, the mapping engine 
on interface 140 connected to telephone 110 would 
identify the series of conversion routines to convert 

20 the microphone's PCM content-type to the television 

screen's bitmap content-type. One of these identified 
conversion routines, text-to-voice/voice-to- text 
application 170, is encapsulated as a media object on 
computer 100. Since all resources encapsulated as media 

25 objects on the network are listed in the various Tables 
Of Resources, they are available to the mapping 
algorithm as if they were on the source appliance 
itself. The mapping algorithm would include computer 
100 as an intermediate hop to which the content will be 

30 routed. Once the message is received by computer 100, 
its header is examined and the mapping algorithm 
operating on computer 10 0 would determine from the 
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source content -type of PCM and the destination content - 
type of bitmap that the content needs to be routed 
through voice- to- text application 170. The Demux 
algorithm operating on computer 10 0 would effect the 

5 conversion of the content. The header would be stripped 
of computer 100 7 s routing address string, and the source 
content -type in the header would be updated to reflect 
conversion of the content to "text" . The message would 
be transmitted across the network to television 115. 

10 Network adapter 140 on television 115 is the last hop in 
the series of appliances the content was routed through. 
The header would be parsed, and the mapping algorithm 
would map the source content-type, which is now "text", 
to the destination content -type of bitmap, and the Demux 

15 algorithm would effect the conversion. The content 
would then be routed to screen 116. 

Switchboard 

The switchboard is the user interface on an 
appliance which is used to map content from one 

20 appliance or resource to another, and is used to 
configure resources. Each appliance has its own 
switchboard. One embodiment of a switchboard is shown 
in Figures 9a and 9b. The switchboard for a particular 
appliance may be a web page displayed in a web browser 

25 showing on the left side of the screen the list of 

resources on the appliance that are sources of content, 
and on the right side a list of appliances known to this 
appliance, that is, those appliances appearing in the 
Table Of Known Appliances shown in Figure 2. Further, 

30 the switchboard can display the resources on each known 
appliance capable of receiving content. The switchboard 
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is used to direct content from a source resource listed 
on the left of the switchboard to a target appliance, or 
target resource on an appliance, listed on the right of 
the switchboard a shown in Figures 9a and 9b. 
5 The switchboard is also used to access the 

controls for resources. When a user clicks on the name 
of a resource, the browser accesses the URL of the 
resource stored in the Table of Resources On An 
Appliance (Figure 3a) . For example, a user clicking on 
10 a speaker resource would see a volume control pop up in 
the browser such as that shown in Figure 10A. Figures 
10b, 10c and lOd are additional examples of controls for 
resources . 

In this embodiment, the user can remotely 

15 access the switchboard of any appliance. This is 

referred to as "browsing" the appliance. For example, 
the user sitting at computer 100 would initially see the 
switchboard shown in Figure 9a. If the user wanted to 
map incoming telephone calls from telephone 110 to 

20 television 115, the user would click on the word 

"telephone" . This causes the browser to access the URL 
of the telephone's switchboard stored in the Table Of 
Known Appliances under the Browse URL heading, and to 
display the telephone's switchboard as shown in Figure 

25 9b. The user now has full remote control over the 
resources on the telephone. Using this method, the 
various appliances such as the telephone that have no 
screen and limited input controls can be browsed and 
configured. Further, any appliance on the network can 

30 be remotely controlled and configured from one location 
on the network just by accessing the switchboard for the 
appliance . 
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In another example, the user at computer 175 
can control thermostat 120 from computer 175. This is 
done by the user at computer 175 accessing the 
switchboard on gateway interface 155, which would show 
5 the thermostat on the right side of the switchboard, and 
then selecting the thermostat, which would display the 
switchboard of the thermostat (the URL of the thermostat 
switchboard is stored in the Table of Known Appliances 
on gateway interface 155 under the heading Browse URL in 

10 Figure 2) . The thermostat switchboard lists the keypad 
as a source of content on the left side of the screen. 
Selecting the keypad accesses the URL of the keypad 
controls, which can look like that shown in Fig 10c. 
The user at computer 175 then has access to the controls 

15 of thermostat 120. 

An alternate embodiment of a switchboard is 
shown in Figure 11. In this embodiment, each appliance 
can generate a switchboard. Such a switchboard provides 
a list of all sources of content in the network and a 

20 list of all the destinations for content on the network. 
At the top of the screen as shown in Figure 11, the 
switchboard displays icons representing source 
categories of content such as "email", "music", or 
"movies", for a user to choose as a source. For 

25 example, "music" for the user's music compact disks. 
When "music" is selected, the list of music titles is 
displayed, and the user can now select from the list to 
map a favorite song to a target appliance, a target 
resource, or a target content -type . 

30 In another embodiment, the screen displays 

categories of sources content, such as Devices, Music, 
etc. When the user selects a category, the user is then 
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presented with sub-categories of content. For example, 
if the user selects the "Music" category, then the user 
is presented with the sub-categories "Jazz", "Rock", 
"Classical", etc. When the user selects one of the sub- 
5 categories of content, the user is presented with a list 
of content on the left of the screen, and a list of 
destinations on the network that can accept such content 
on the right side of the screen. For example, if the 
user selects Jazz, then on the left side of the screen 

10 the user will be presented with a list of Jazz songs 
available somewhere on the network, for example on 
compact disks in various stereos on the network. On the 
right side of the screen the user is presented with a 
list of the destination resources on the network that 

15 can accept audio content, for example, the speakers on a 
television, the speakers on a stereo, the speaker on a 
telephone, etc. In another example of this embodiment, 
if the user chooses the category "Devices" , the user is 
presented with a list of sub-categories of devices on 

20 the network that can be sources of content . Examples of 
such sub-categories are "microphones", "pointing 
devices", etc. If the user chooses "microphones", then 
a list of all the microphones on the network are 
displayed on the left side of the screen, and a list of 

25 all the resources on the network that can accept 

microphone content, such as the speakers on a stereo or 
the speakers on a television are displayed on the right 
side of the screen. The user can map a source of 
content on the left side of the screen, such as a song, 

30 to a destination resource on the right side of the 

screen, such as the speaker on a television by clicking 
on them with a pointing device. This instructs the 
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mapping algorithm to identify the series of routines to 
convert the source content to the destination content, 
and to store the identification of the series of 
routines in memory. This is referred to as a cached 
5 mapping. 

The user's ability to control the routing of 
content from a source resource on a source appliance to 
a target resource on a target appliance will now be 
described with reference to Figure 6 . The user located 

10 at an appliance activates the switchboard, displaying 
the list of resources on the appliance the user is 
physically using and the list of other appliances on the 
network discovered through the discovery process as 
described above with reference to Figure 4 and 5 are 

15 hard-coded by an administrator. The user then selects a 
source appliance, which displays the switchboard of the 
source appliance identified by the Browse URL stored in 
the table of known appliances (Step 605) . 

The list of resources on the source appliance 

20 is displayed at step 610. The user then selects a 
source resource (Step 615) . An example of a source 
resource is a CD-ROM player. Next, the user examines 
the list of target appliances listed on the switchboard 
(Step 620) , and selects a target appliance (Step 625) . 

25 The user could stop here and jump to Step 650 to 

configure the source resource to begin transmitting the 
data (described below) to the appliance, thereby letting 
mapping algorithm on the target appliance decide to what 
resource on the target appliance the data should be 

30 directed. The target appliance directs data to default 
resources depending on the content -type the data 
represents based on the mapping algorithm. For example, 
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media of source content -type PCM might be mapped by the 
mapping algorithm to a speaker. 

However, the user might want the PCM data 
(generated by a microphone on the source device) to be 
5 directed to the screen on the target appliance. To do 
so, the user would continue on to Step 63 0 and examine 
the list of resources on the target appliance capable of 
receiving input. The user then selects at target 
resource from the list (Step 635) . This causes the 

10 switchboard to cache the path to the targeted resource 
as described in U.S. Patent Application No. 09/304,973 
entitled "Method And System For Generating A Mapping 
Between Types Of Data" . 

At step 640, the user browses the source 

15 resource by accessing the web page identified in the 
Table Of Resources On An Appliance by the entry under 
Configure URL for this resource stored in the table of 
known appliances. The user then configures the source 
resource to begin transmitting the content (Step 650) . 

20 For example, one embodiment of the web page for 

configuring a CD-ROM is shown in Figure lOd. When the 
web page is accessed, the controls for a CD-ROM such as 
play, stop, fast forward and rewind are displayed in the 
page for the user to control. 

25 Discovery Process 

The information about each appliance (referred 
to below as "Info") stored in the Table Of Known 
Appliances (Figure 2) , Table Of Resources On An 
Appliance (Figure 3a) and Table Of Special Cases (Figure 
30 3b) can be hard-coded into the tables and stored on each 
appliance by an administrator, or they can be discovered 
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via a discovery process and stored on each appliance. 
One example of a discovery process is described below. 

Figures 4 and 5 are two independent threads 
running concurrently on an appliance (or running on a 
5 network adapter 14 0 attached to the appliance) . Figure 
4 is a flowchart representing the thread that listens 
for messages, and when a message is received, sets the 
appropriate flags or counters as described below. 
Figure 5 is a flowchart representing the thread that 
10 examines the flags and counters and decides how to act 
on them. 

The first thread in the discovery process will 
now be described with reference to Figure 4 . At step 
405, the thread waits for a message. When a message is 

15 received from another appliance, it is checked to see 

what kind of message it is. At step 410, the message is 
checked to see if it is an Info message. An Info 
message, described in detail below, contains information 
about the appliance, including the resources attached to 

20 it and instructions detailing how to send data to the 

appliance and its resources. If it is an Info message, 
then at Step 415 the contents of the Info message are 
entered into the Table of Known Appliances and the Table 
of Resources for that appliance, and Table of Special 

25 Cases (Figures 2, 3a and 3b) . This table is stored in 
the receiving appliance's memory 102 or 144. After 
steps 415, 425 435, 450 or 455 have been completed, 
thread then loops back to step 405 to wait for the next 
message . 

30 If the message is not an Info message, then at 

step 420 the message is examined to see if it is a Hello 
message. Hello is a signal that an appliance broadcasts 
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across the network to which it is attached upon power-up 
that signals to the other appliances on the network to 
broadcasts their Info message. Hello messages from all 
appliances are identical. This enables the newly 
5 powered-up appliance to populate its Table of Known 
Appliances and Table of Resources for each appliance 
with information about each appliance attached to the 
network. If the message is a Hello message, then at 
step 425 the Hello Flag is set to 1. The Hello flag is 

10 stored in memory 102 in the appliance or in memory 144 
in network interface 14 0 attached to the appliance. 
After setting the Hello flag, the thread loops back to 
step 405 to wait for the next message. 

If the message is not a Hello message, then at 

15 step 43 0 the message is examined to see if it is a Leave 
message. If the message is a Leave message, then at 
step 435 the Leave Flag is set to 1 for the appliance 
that sent the message. This flag can be stored in the 
Table of Known Appliances as shown in Figure 2. After 

20 setting the Leave flag, the thread loops back to step 
4 05 to wait for the next message. 

If the message is not a Leave message, then at 
step 440 the message is examined to see if it is a 
Heartbeat message. If the message is a Heartbeat 

25 message, then at step 445 it is checked to see if the 
Heartbeat is from a known appliance. If the Heartbeat 
is from a known appliance, then the Heartbeat counter 
for that appliance is reset to a pre-defined level, for 
example, 6 (Step 450) . The Heartbeat counter can be 

30 stored in the Table of Known Appliances as shown in 
Figure 2. If the Heartbeat is from an unknown 
appliance, then at step 455 the Unknown Appliance flag 



- 29 - 

is set. The Unknown Appliance flag can be stored in 
memory 102 in the appliance or in memory 144 in network 
interface 140 attached to the appliance. 

The discovery process on an appliance will now 
5 be described with reference to Figure 5. At step 505, 
an appliance powers up. An appliance is anything 
connected to a local network capable of identifying 
itself to the network. Examples are computers, DVD 
players, telephones, televisions, and PDAs. The 

10 appliance then broadcasts a "Hello" message. Hello is a 
signal that a machine broadcasts across the local 
network upon power up, which signals to the other 
appliances on the network to broadcast their "Info" 
messages (Step 507) . The appliance then broadcasts its 

15 "Info" message across the local network (Step 508) which 
received by the other appliances on the local network. 
In response to receiving the Hello message from the 
appliance, the other appliances on the local network 
send their Info messages across the local network which 

20 are received by the appliance as described above with 
reference to Figure 4. 

The appliance then checks to see if the Hello 
flag is set to 1 (Step 510) . If so, then the appliance 
broadcasts its Info message across the network and sets 

25 the Hello flag to 0 (Steps \515 and 516). If not, then 
the appliance broadcasts itis "Heartbeat" (Step 520) . 
The Heartbeat is a messag^ sent from each appliance 
indicating that the appliance is still connected to the 
local network. It contains a unique ID for each 

30 appliance. An example of the unique ID is the IP 
address . 
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The appliance then checks to see if the 
Unknown Appliance flag is set to 1 (Step 525) . If so, 
then the appliance broadcasts a Hello message so that 
the unknown appliances on the network broadcast their 
5 Info messages, and the Unknown Appliance flag is reset 
to 0 (Step 530) . 

The appliance then decrements the Heartbeat 
Counters for all of the appliances listed in the Table 
Of Known Appliances (Step 535) . The appliance then 
10 checks to see if any of the Heartbeat Counters in the 

Table of Known Appliances is equal to 0 (Step 540) . If 
so, then those appliances whose Heartbeat Counters equal 
0 are removed from the Table Of Known Appliances (Step 
545) . 

15 The appliance next checks to see if the 

"Leave" flag is set for any appliance (Step 550) . If 
so, then any appliances whose Leave flag is set is 
removed from the Table Of Known Appliances, and the 
Table of Resources for those appliances are deleted from 

20 memory (Step 555) . 

The appliance then checks to see if it itself 
is shutting down (Step 557) . If so, then the appliance 
broadcasts its Leave message across the network (Step 
558), and the thread ends. If not, then the appliance 

25 sleeps for a specified period (Step 560) , for example 10 
seconds, and then loops back up to Step 510. 

Although one discovery process has been 
described, any well-known discovery process such as 
Jini, NetBios Discovery, could be substituted for the 

30 above discovery process. 

It will be apparent to those skilled in the 
art that various modifications and variations can be 
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made in the system and processes of the present 
invention without departing from the spirit or scope of 
the invention. Thus, it is intended that the present 
invention cover the modifications and variations of this 
invention provided they come within the scope of the 
appended claims and their equivalents. In this context, 
equivalents means each and every implementation for 
carrying out the functions recited in the claims, even 
if not explicitly described herein. 
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Claims 

What is claimed is: 



1 1. A system for routing data across a 

2 network , comprising : 

3 a source appliance; 

4 a destination appliance connected to the 

5 source appliance via a network; 

6 data of a particular source content -type 

7 to be transmitted across the network from the source 

8 appliance to the destination appliance; and 

9 a header appended to the data, the header 

10 comprising a destination appliance routing address 

11 string and the source content- type . 

1 2 . The system of claim 1 wherein the 

2 destination appliance further comprises a processor, the 

3 processor using a mapping algorithm operating on the 

4 data to identify the destination content -type based on 

5 the source content-type and to identify the series of 

6 routines necessary to convert the source content-type to 

7 the destination content type. 

1 3 . The system of claim 2 wherein the 

2 processor further uses a demultiplexing algorithm 

3 operating on the data to effect the conversion of the 

4 content from the source content-type to the destination 

5 content type . 

1 4 . The system of claim 1 wherein the header 

2 further comprises a destination content -type . 
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1 5 . The system of claim 4 wherein the header 

2 further comprises an intermediate content-type. 



1 6. The system of claim 1 wherein the header 

2 further comprises an intermediate content-type. 

1 7. The system of claim 1 wherein the header 

2 further comprises an intermediate appliance routing 

3 address string . 

1 8. The system of claim 7 further comprising 

2 an intermediate appliance having a resource for 

3 converting the data from the source content -type to the 

4 destination content- type . 

1 9. The system of claim 1 further comprising: 

2 a memory device connected to the source 

3 appliance; and 

4 a table of information stored in the 

5 memory device comprising a destination appliance routing 

6 address string . 

1 10. The system of claim 9 wherein the table 

2 further comprises a destination content-type. 

1 11. The system of claim 10 wherein the header 

2 further comprises an intermediate appliance routing 

3 address string. 

1 12 . A system for routing data across a 

2 network , comprising ; 

3 a source appliance; 
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4 a source resource connected to the source 

5 appliance ; 

6 a destination appliance connected to the 

7 source appliance via a network; and 

8 a table of information stored in a memory 

9 device connected to the source appliance comprising the 

10 destination appliance routing address string and a 

11 destination resource content-type. 

1 13 . The system of claim 12 further comprising 

2 a destination resource connected to the destination 

3 appliance . 

1 14. The system of claim 13 wherein the 

2 destination resource is encapsulated as a media object. 

1 15 . The system of claim 12 further 

2 comprising : 

3 a header appended to the data, wherein 

4 the header encapsulates the data, and wherein the header 

5 comprises a destination appliance routing address string 

6 and a source content-type. 

1 16. The system of claim 15 wherein the header 

2 further comprises a destination content- type . 

1 17. The system of claim 15 wherein the header 

2 further comprises an intermediate appliance routing 

3 address string. 

1 18. The system of claim 17 wherein the header 

2 does not contain information identifying the source 

3 appliance. 



1 19. A header comprising: 

2 a destination appliance routing address 

3 string; and 

4 a source content -type address string 

5 appended to the destination appliance routing address 

6 string. 

1 20. The header of claim 19 further comprising 

2 a destination content-type address string appended to 

3 the source content-type address string. 

1 21. The header of claim 19 further comprising 

2 an intermediate appliance routing address string 

3 appended to the destination appliance routing address 

4 string. 

1 22. A method for routing content, comprising: 

2 building a header comprising at least a 

3 source content -type address string and a destination 

4 appliance routing address string ; 

5 encapsulating the content in the header; 

6 and 

7 transmitting the encapsulated content 

8 across a network to a destination appliance. 

1 23. The method of claim 22 further 

2 comprising: 

3 identifying the source content-type by 

4 parsing the header at the destination appliance; 

5 determining via a mapping algorithm what 

6 the target content -type should be based on the source 

7 content - type ; and 
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8 converting the source content-type to the 

9 target content-type. 

1 24. The method of claim 22 wherein the header 

2 further comprises a destination content-type address 

3 string. 

1 25. The method of claim 24 wherein the header 

2 further comprises an intermediate appliance routing 

3 address string, 

1 26. A method comprising: 

2 receiving a message from a network, the 

3 message having a header and content; 

4 parsing the header to identify a source 

5 content -type; and 

6 determining a destination content-type. 

1 27. The method of claim 26 wherein the 

2 destination content-type is determined via a mapping 

3 algorithm. 

1 28. The method of claim 27 further 

2 comprising: 

3 effecting the conversion of the content 

4 from the source content-type to the destination content- 

5 type . 

1 29. The method of claim 28 wherein the 

2 conversion of the content is effected by a 

3 demultiplexing algorithm. 



1 



30. A method comprising: 
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2 receiving a message from a network, the 

3 message having a first header and content; 

4 parsing the first header to identify a 

5 source content- type and a destination content-type; 

6 converting the content to an intermediate 

7 content -type; 

8 encapsulating the content in a second 

9 header, the second header comprising an intermediate 

10 content -type and a destination content -type; and 

11 transmitting the message across the 

12 network to a destination appliance. 

1 31. The method of claim 3 0 wherein the first 

2 header comprises a source content-type address string, a 

3 destination content-type address string, an intermediate 

4 appliance routing address string, and a destination 

5 appliance address string. 

1 32. The method of claim 31 wherein the second 

2 header comprises an intermediate content -type address 

3 string, a destination content-type address string, and a 

4 destination appliance routing address string. 

1 33 . A network adapter connected between an 

2 appliance and a network, comprising: 

3 a memory device; and 

4 a first table stored in the memory device 

5 comprising information identifying a destination 

6 appliance connected to the network, and routing 

7 information corresponding to the destination appliance. 

1 34. The network adapter of claim 33 further 

2 comprising: 
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3 a second table stored in the memory 

4 device identifying a resource on the destination 

5 appliance. 

1 3 5. A gateway interface connected between a 

2 first network and a second network comprising: 

3 a memory device; 

4 a first table stored in the memory device 

5 comprising information identifying a destination 

6 appliance connected to the first network and routing 

7 information corresponding the destination appliance. 

1 36. The gateway interface of claim 33 further 

2 comprising a second table of information stored in the 

3 memory device identifying a resource on the destination 

4 appliance. 

1 3 7. A method for routing content, comprising: 

2 receiving source resource information; 

3 receiving destination appliance 

4 information; 

5 determining the destination appliance 

6 routing address string; and 

7 transmitting the content from a source 

8 resource to a destination appliance based on the 

9 destination appliance routing address string. 

1 38. The method of claim 37 further 

2 comprising: 

3 receiving a request for a web page 

4 containing controls for the source resource; 

5 transmitting the web page to the screen; 
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6 receiving signals to configure the source 

7 resource to transmit the content. 
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processor; 



the screen; 



A system for routing content, comprising: 
a processor 

a screen connected to the processor; 
a memory device connected to the 

a list of source resources displayed on 



a list of destination appliances 
displayed on the screen; 

a signal to the processor indicating one 
of the source resources displayed on the screen was 
selected; 

a signal to the processor indicating one 
of the destination appliances displayed on the screen 
was selected; and 

a table stored in the memory device 
having an entry for a destination appliance routing 
address corresponding to selected destination appliance. 



1 40. A user interface, comprising: 

2 a screen; 

3 categories of sources of content 

4 displayed on the screen; 

5 subcategories of sources of content 

6 displayed on the screen corresponding to a selected 

7 category displayed on the screen ; 

8 a list of content displayed on the screen 

9 corresponding to a selected subcategory; and 
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10 a list of destinations displayed on the 

11 screen capable of receiving the content. 

1 41. A method for discovering appliances on a 

2 network, comprising: 

3 receiving a first message from an 

4 appliance connected to the network; 

5 if the message contains information 

6 indicating how to route data to the appliance, then 

7 placing an entry of the information into 

8 a table; 

9 if the message is requesting routing 

10 information from other appliances, then 

11 broadcasting routing information across 

12 the network; 

1 42. The method of claim 41 further 

2 comprising: 

3 if the message is requesting routing 

4 information, then 

5 broadcasting a signal containing 

6 information describing how to route content to the 

7 appliance. 

1 43. The method of claim 42 wherein the 

2 routing information includes a signal containing 

3 information about a resource on the appliance. 

1 44. The method of claim 42 further 

2 comprising: 

3 if the message indicates that the 

4 appliance is leaving the network, then 
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5 removing the entry for the appliance from 

6 the table. 

1 45. The method of claim 44 further 

2 comprising: 

3 if the message is a signal indicating 

4 that the appliance is present on the network and the 

5 appliance has no entry in the table, then 

6 broadcasting a request across the network 

7 to the appliance asking the appliance to broadcast 

8 information describing how to route content to the 

9 appliance. 

1 46. The method of claim 45 further 

2 comprising: 

3 if a specified time period has passed and 

4 no signal has been received from the appliance 

5 indicating that the appliance is still connected to the 

6 network, then removing the entry for the appliance from 

7 the table. 

1 47 . A system for discovering appliances on a 

2 network comprising: 

3 a network; 

4 a first appliance connected to the 

5 network; and 

6 a signal received by the first appliance 

7 from a second appliance connected to the network, the 

8 signal including routing information to route content to 

9 the second appliance and including the identity of the 
10 second appliance. 



1 48. The system of claim 47 further 

2 comprising: 

3 a table stored in a memory on the first 

4 appliance into which the routing information is entered. 

1 49. The system of claim 48 wherein the signal 

2 includes information indicating the resources on the 

3 second appliance capable of receiving or transmitting 

4 content . 
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Abstract 

A method and system for routing media from a 
source resource on a source appliance across a network 
to a destination resource on a destination appliance. 
5 The particular destination resource on a destination 
appliance can be specified. Alternatively, the 
particular destination appliance is specified but the 
particular resource on the destination appliance is not 
specified. An intermediate appliance having a resource 

10 for converting the media from a source media- type to a 

destination media- type can be further specified. A user 
interface is provided to allow a user to specify the 
source and destination of the media. A discovery 
process is provided to allow appliances to discover the 

15 other appliances and resources available on the network. 
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Figure 4 



405 
Wait for 
message 




set Heartbeat counter 
for that appliance 



455 

Set Unknown 
Appliance Flag 



505 



Appliance 
Powers up 



507 



Broadcast 
"Hello" message 



Figure 5 



508 



Broadcast 
"Info" message 




Yes 



515 



Broadcast 
Info" Message 



516 



Set "Hello" 
Flag to 0. 



525 
Is "Unknown 


Yes 

> ► 


530 Broadcast 
"Hello" Message and 


Appliance" 
^\Flag Set?^-^ 




set Unknown Appliance 
flag to 0. 


No ■ 


4 








r 








535 

Decrement 
Heartbeat counters for 
all appliances on list. 









560 




Yes 



545 

Remove from Table of 
Known Appliances those appliances 
where Heartbeat counter = 0 



Yes 



"Sleep" for 
specified period 



555 



Remove from 
Table of Known Appliances 
those appliances whose 
leave flag is set 



Yes 


558 




Broadcast "Leave" message 



Figure 6 



605 



Access switchboard of a 
source appliance 

i 



610 

Examine list of source 
resources on source appliance 



615 

Select a source resource 



620 

Examine list of target 
appliances 



625 

Select a target appliance 



630 

Examine list of resources 
on target appliance 



635 




Select a target resource 


from the list of resources 




r 


640 




Browse source resource 



650 

Configure source resource 
to begin transmitting data 



Figure 7 



705 

Build header containing at least the source 
content type and the destination appliance 
routing address string 

+ 

710 

Encapsulate content in header 
712 

Mapping algorithm on source appliance 
determines, using destination appliance 
routing address string, the series of 
conversion routines necessary to transmit 
the content to the destination appliance 
across the network. 
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714 

Demux algorithm on source appliance 
effects the conversion of the content for 
transmission across the network 



715 

Transmit the encapsulated content across a 
network to the destination appliance 

720 

Destination appliance parses header and 
identifies the source content type from 
the information in the header 



725 

Mapping algorithm on destination 
appliance determines the destination 
content type and identifies the series of 
conversion routines to convert the source 
content type to the destination content type. 
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Demux algorithm on destination appliance 
effects the conversion of content from 
source type to target type 
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Build header containing the source content 
type, destination appliance routing address 
string and destination content type address 
string 
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810 

Encapsulate content in header 



812 

Mapping engine on source appliance 
determines, using destination appliance 
routing address string and the content-type 
address string, the series of conversion 
routines necessary to transmit the content to 
the target resource on the target appliance 



814 

Demux algorithm on source appliance 
effects the conversion of content for 
transmission across the network 
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Transmit the encapsulated content across a 
network to the destination appliance 



820 

Destination appliance parses header, and 
identifies source content type and destination 
content type from the information in the header 



825 

Mapping algorithm on destination appliance 
identifies the series of routines to convert the 
source content type to the destination content type 



830 

Demux algorithm on destination appliance 
effects the conversion of content from source 
content type to destination content type 
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ORIGINAL, DESIGN, NATIONAL STAGE OF PCT, SUPPLEMENTAL 
DIVISIONAL, CONTINUATION OR CONTINUATION-IN-PART APPLICATION 

As a below name inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is 
sought on the invention entitled: 

Media Routing 



the specification of which 

a. [ X] is attached hereto 

b. [ ] was filed on as application Serial No. and was amended 

on . (if applicable). 

PCT FILED APPLICATION ENTERING NATIONAL STATE 

c. [ ] was described and claimed in International Application No. filed on 

and as amended on . (if any). 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including 
the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the examination of this application in 
accordance with Title 37, Code of Federal Regulations, § 1.56(a). 

I hereby specify the following as the correspondence address to which all communications about this application 
are to be directed: 

SEND CORRESPONDENCE TO: MORGAN & FINNEGAN, L.L.P 

345 Park Avenue 
New York, N.Y. 10154 

DIRECT TELEPHONE CALLS TO: Gerard A. Haddad 

(212)415-8547 

[ ] I hereby claim foreign priority benefits under Title 35, United States Code § 1 19(a)-(d) or under 
§ 365(b) of any foreign application(s) for patent or inventor's certificate or under § 365(a) of any PCT 
international application(s) designating at least one country other than the U.S. listed below and also have 
identified below such foreign application(s) for patent or inventor's certificate or such PCT international 
application(s) filed by me on the same subject matter having a filing date within twelve (12) months before that 
of the application on which priority is claimed: 

[ ] The attached 35 U.S.C. § 1 19 claim for priority for the application(s) listed below forms a part of this 
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Application Date of filing Date of Issue Priority 

Countrv/PCT Number fdav. month, yr) (day, month, yr) Claimed 

[ ] YES [ ] NO 



[ ] YES [ ] NO 



[ ] YES [ ] NO 



[ ] I hereby claim the benefit under 35 U.S.C. § 1 19(e) of any U.S. provisional application(s) listed below. 
Provisional Application No. Date of Filing (day, month, yr) 



ADDITIONAL STATEMENTS FOR DIVISIONAL, CONTINUATION OR CONTINUATION-IN-PART 
OR PCT INTERNATIONAL APPLICATIONS) (DESIGNATING THE U.S.) 

I hereby claim the benefit under Title 35, United States Code § 120 of any United States application(s) or under 
§ 365(c) of any PCT international application(s) designating the U.S. listed below. 



US/PCT Application Serial No. Filing Date Status (patented, pending, abandoned)/ 

U.S. application no. assigned (For PCT) 



US/PCT Application Serial No. Filing Date Status (patented, pending, abandoned)/ 

U.S. application no. assigned (For PCT) 

[ ] In this continuation-in-part application, insofar as the subject matter of any of the claims of this 
application is not disclosed in the above listed prior United States or PCT international application(s) in the 
manner provided by the first paragraph of Title 35, United States Code, § 112, 1 acknowledge the duty to 
disclose material information as defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred 
between the filing date of the prior application(s) and the national or PCT international filing date of this 
application. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or Imprisonment, or both, under Section 
1001 of Title 18 of the United States Code and that such willful false statements may jeopardize the validity of 
the application or any patent issued thereon. 

I hereby appoint the following attorneys and/or agents with full power of substitution and revocation, to 
prosecute this application, to receive the patent, and to transact all business in the Patent and Trademark Office 
connected therewith: John A. Diaz (Reg. No. 19,550), John C. Vassil (Reg. No. 19,098), Alfred P. Ewert (Reg. 
No. 19,887), David H. Pfeffer, P.C. (Reg. No. 19,825), Harry C. Marcus (Reg. No. 22,390), Robert E. Paulson 
(Reg. No. 21,046), Stephen R. Smith (Reg. No. 22,615), Kurt E. Richter (Reg. No. 24,052), J. Robert Dailey 
(Reg. No. 27,434), Eugene Moroz (Reg. No. 25,237), John F. Sweeney (Reg. No. 27,471), Arnold I. Rady (Reg. 
No. 26,601), Christopher A. Hughes (Reg. No. 26,914), William S. Feiler (Reg. No. 26,728), Joseph A 
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Calvaruao <Reg> No. 28,2s?), lames W. Gould (Reg, No. 28,859), Richard c. Komson (Reg. No. 27,913), Israel 
Blum (Reg. No. 26,710), Bartholomew Vetdinune (Reg. No. 28,483), Maria CH, Lin (reg. No, 29,323), Joseph 
A. DeGirolamo £Rcr. No, 28,595), Michael A. Nicodema fRcg. No, 33,199), Michael F Dougherty (Reg No. 
32,730), Seth 1, Atlas (Reg. No. 32,454), Andrew M* Riddles (Reg. No. 31,657), Bruce D. DeRcn2i(Reg. No. 
33,676), Michael M. Murray {Reg. No 32,537), Mark J Abate (Reg. No. 32,527), Alfred L. Hafmer, Jr. (Reg. 
No. 18,919), HaroW Hai# (Reg No. 17,50% John T. GiOtagher (Reg. No. 35,5 1 6), Steven P. Meyer (Reg. No. 
35,613) and Kenneth H. SonnenfeJd (Reg. No. 33,285} of Morgan & Finnegen, LX.P. whose address « . 345 
Park Avenue, New York, New York, J0154; and Edward A. Pcnniogic* (Reg. No. 32,588), Michael S. Marcus 
(Reg. No. 3 1,727) and Jotro E. Hoel (Reg, No, 26,279) of Morgan & Fiw*gan. L L P,, whose address is 1775 
Eye Street, Suite 400, Washington, D.C 20006. 

[ | I hereby authorize the U.S. attorneys and/or agents fumed hereinabove to accept acid follow 
instructions from 



as to any action to be taken in the U.S. Patent and Trademark Office 

regarding this application without direct communication between the U.S. attorneys anoVbr agents and 
me. In the event of a change in the persons) from whom instructions may be taken I will so notify the 
U.S. attorneys and/or agents hereinabove. 



Full name of sole or first inventor Edward Balassaruan 



Inventor 1 s signature* ^^^^^ — Jc A ~ O V 

date 

Residence 12724 NE 94 Ui CT, Kirkiand WA> 98033 

Citizenship United States ^ 

Post Office Address 12724 NE 94* CT, Kirktend, WA., 98033 



Full name of second joint 

inventor, if any _ 

Inventor 's signature* 

date 

Residence 1 1 

Citizenship ^ t : 

Post Office Address 
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1 . Review the declaration and verily die correctness of M information therein; and 

2. Review the specification and the claims including any amendments made to the claims. 

After She declaration is signed, the specification and claims are not to be altered. 



-3- 



Docket No. 3802-4001 



To the inventor(s): 

The following are cited in or pertinent to the declaration attached to the accompanying application: 

Title 37, Code of Federal Regulation, § 1.56 

Duty to disclose information material to patentability. 

(a) A patent by its very nature is affect with a public interest. The public interest is best served, 
and the most effective patent examination occurs when, at the time an application is being examined, 
the Office is aware of and evaluates the teachings of all information material to patentability. Each 
individual associated with the filing and prosecution of a patent application has a duty of candor and 
good faith in dealing with the Office, which includes a duty to disclose to the Office all information 
known to that individual to be material to patentability as defined in this section. The duty to disclose 
information exists with respect to each pending claim until the claim is canceled or withdrawn from 
consideration, or the application becomes abandoned. Information material to the patentability of a 
claim that is canceled or withdrawn from consideration need not be submitted if the information is not 
material to the patentability of any claim remaining under consideration in the application. There is no 
duty to submit information which is not material to the patentability of any existing claim. The duty to 
disclose all information known to be material to patentability is deemed to be satisfied if all 
information known to be material to patentability of any claim issued in patent was cited by the Office 
or submitted to the Office in the manner prescribed by §§ 1 .97(b)-(d) and 1 .98. However, no patent will 
be granted on an application in connection with which fraud on the Office was practiced or attempted 
or the duty of disclosure was violated through bad faith or intentional misconduct. The Office 
encourages applicants to carefully examine: 

(1) prior art cited in search reports of a foreign patent office in a counterpart application, 

and 

(2) the closest information over which individuals associated with the filing or 
prosecution of a patent application believe any pending claim patentably defines, to 
make sure that any material information contained therein is disclosed to the Office. 

Title 35, U.S. Code § 101 
Inventions patentable 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

Title 35 U.S. Code $ 102 

Conditions for patentability; novelty and loss of right to patent 
A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a 
printed publication in this or a foreign country, before the invention thereof by the applicant for patent, 

(b) the invention was patented or described in a printed publication in this or foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in the United 
States, or 

(c) he has abandoned the invention, or 
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(d) the invention was first patented or caused to be patented, or was the subject of an inventor's 
certificate, by the applicant or his legal representatives or assigns in a foreign country prior to the date of the 
application for patent in this country on an application for patent or inventor's certificate field more than twelve 
months before the filing of the application in the United States, or 

(e) the invention was described in a patent granted on an application for patent by another filed in 
the United States before the invention thereof by the applicant for patent, or on an international application by 
another who has fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this title before 
the invention thereof by the applicant for patent, or 

(f) he did not himself invent the subject matter sought to be patented, or 

(g) before the applicant's invention thereof the invention was made in this country by another had 
not abandoned, suppressed, or concealed it. In determining priority of invention there shall be considered not 
only the respective dates of conception and reduction to practice of the invention, but also the reasonable 
diligence of one who was first to conceive and last to reduce to practice, from a time prior to conception by the 
other . . . 



Title 35, U.S. Code S 103 

Conditions for patentability; non-obvious subject matter 

A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the prior art 
are such that the subject matter as a whole would have been obvious at the time the invention was made to a 
person having ordinary skill in the art to which said matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Subject matter developed by another person, which qualifies as prior art only under subsection (f) or 
(g) of section 102 of this title, shall not preclude patentability under this section where the subj ect matter and the 
claimed invention were, at the time the invention was made, owned by the same person or subject to an 
obligation of assignment to the same person. 



Title 35, U.S. Code $ 1 12 (in part) 
Specification 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise and exact terms also enable any person skilled in the art to 
which it pertains, or with which it is mostly nearly connected, to make and use the same, and shall set forth the 
best mode contemplated by the inventor of carrying out his invention. 



Title 35, U.S. Code § 119 

Benefit of earlier filing date in foreign country; right of priority 

An application for patent for an invention filed in this country by any person who has, or whose legal 
representatives or assigns have, previously regularly filed an application for a patent for the same invention in 
foreign country which affords similar privileges in the case of applications filed in the United States or to 
citizens of the United States, shall have the same effect as the same application would have if filed in this 
country on the date on which the application for patent for the same invention was first filed in such foreign 
country, if the application in this country is filed within twelve months from the earliest date on which such 
foreign application was filed; but no patent shall be granted on any application for patent for an invention whi< 
had been patented or described in a printed publication in any country more than one year before the date of th 
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actual filing of the application in this country, or which had been in public use or on sale in this country more 
than one year prior to such tiling. 

Title 35, U.S. Code $ 120 

Benefit or earlier filing date in the United States 

An application for patent for an invention disclosed in the manner provided by the first paragraph of 
section 1 12 of this title in an application previously filed in the United States, or as provided by section 363 of 
this title which is filed by an inventor or inventors named in the previously filed application shall have the same 
effect as to such invention, as though filed on the date of the prior application, if filed before the patenting or 
abandonment of or termination of proceedings on the first application or an application similarly entitled to the 
benefit of the filing date of the first application and if it contains or is amended to contain a specific reference to 
the earlier filed application. 

Please read carefully before signing the Declaration attached to the accompanying Application. 
If you have any questions, please contact Morgan & Finnegan, L.L.P. 
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